Gateway: A System to Automatically Decompose Complex Environments

This article presents a methodology, and an associated system called Gateway, for automatically breaking complex Markov environments into a series of smaller regions. In turn, these regions form a kind of hierarchy that is useful in improving learning efficiency. The methodology has its roots in the cognitive mapping literature and requires adding little or no prior knowledge to the Gateway system.